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[57] ABSTRACT 

Data items are arranged into groups and each group is 
represented by a graphical object (a so-called landmark) for 
easily identifying each group and its corresponding data 
items on a screen display. The landmark may have display 
attributes (such as shape, color, size, function, animation, 
etc.) which are different from the display attributes of 
another landmark. Each landmark has two non-parallel lines 
(grid lines) associated therewith and is positioned at the 
intersection of the two lines providing directional orientation 
when the landmark is displaced on the screen display. 

11 Claims, 7 Drawing Sheets 
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IDENTIFICATION OF DATA ITEMS ON A ~ The disadvantage of this approach lies in the user's 

SCREEN DISPLAY USING LANDMARK AND inability to view all of the items (or even groups) at the same 

GRID LINE GRAPHICAL OBJECTS time on the screen display. 

RAPKHROUNn OF THE INVENTION WUh b ° lh WW 1 ™ and z° omin g navigation needs, 

BACKGROUND OF THE INVLMiON s ^ ^ & need tQ develop various ways t0 help the user 

The present invention is related to a Graphical User personalize, navigate and recognize its data. 

Interface (GUI) and in particular, to apparatus and method INVENTION 
for easily and quickly identify mg a group of data items from 

a number of data items displayed on a screen display by It is an object of the present invention to overcome the 

using a preselected graphical object (that is, a so-called 10 above disadvantages. 

landmark) which represents a desired group of data items, It is another object of the present invention to provide a 

wherein the data items are stored in a storage device being graphical object for representing a group of data items on a 

operative via a programmable controller and are displayed screen display. 

on the screen display being operative via the programmable j t ^ a funhe,- object of the present invention to provide a 

controller. * 5 graphical object having various display attributes for easily 

As well known in the art, the Graphical User Interface identifying 00 the screen display a group of data items 

allows a user of a computer system to view data items (such associated with the graphical object, 

as still or full-motion images, for example) on the screen SUMMARY OF THE INVENTION 
display in a simple and user-fnendly manner. The displayed 

items may be graphical or textual, and are stored in a 20 These and other objects, features and advantages are 

memory storage of the computer system. accomplished by a system and method* for controlling a 

Using an input device and the GUI features, the user may screen display of data items. The data items are arranged into 

arrange items into groups such that each item within a group * number of groups on the screen. A graphical object is then 

is related to other items within that same group. The generated and assigned to one of the groups for representing 

relationship among the group items may be temporal, 25 respective data items associated with that group, 

contextual, etc., as preselected by the user. In accordance with one aspect of the present invention, 

Use of a system that enables collecting, organizing and the graphical object is generated in such a way that its 

browsing data in a graphic and zoomable space creates display attributes differ from the display attributes of another 

certain needs for navigating this data. Zooming, which „ graphical object displayed on the screen display. The display 

allows the user to make on-screen objects larger and smaller, attributes may include at least one of the following: shape, 

creates the need to organize information in new ways. color, size, function and animation such as blinking, 

In a purely graphical space, data is organized geographi- rotation, etc. 

cally while in a zooming space, dafa may be organized by In accordance with another aspect of the present 

relative size. As more and more data objects are arranged 35 invention, two non-parallel lines are generated that corre- 

geographically, it becomes hard to find particular objects in spond to the graphical object which is positioned at the 

the space. Also as on-screen objects are zoomed out (made intersection of the two lines. The lines provide directional 

smaller), the objects appear to merge with each other and orientation when displacing the graphical object on the 

then disappear. screen ^P 1 ^- 

That is, as the displayed items (and the corresponding 40 BRIEF DESCRIPTION OF THE DRAWINGS 

groups) mcrease on the screen display, it becomes more and ^ above . mentioned ^ well as additi onal objects, fea- 

more difficult for the user to identify individual items ^ and advant of thc t invention win become 

(objects) or even groups Namely, m order to fit all of the re t from ^ followi detailed description 

items on the screen display their size must decrease when thereof fc to be read {n conjunction ^ the accom . 

new items are added. Clearly, at some point the area of the 45 d m which; 

display screen becomes too small for any intelligible view- * . , eA t > t , . , ... , 

. K ' , • j- 4- • u ui / u FIG. 1 is a screen display of data items (such as digitized 

ing: the items become indistinguishable from each other, and \ . 3 . v & 

* n a- <- photographs, for example) arranged into three groups; 

the separation among the groups virtually disappears. ™f „ . , r * * . f/i V i\ 

11 jl ,1 i r . u ** «• FIG. 2 is a screen display of a graphical object (landmark) 

Under the above circumstances, when attempting to select e f fa * . J - v ... # . ' 

... c *u for representing one of the groups in FIG. 1 while the 

a desired group or item from the group, the user may have 50 j - 5 * u-jJ c- * 

to go through a "trial-and-erro7" selection process by ^°!*"* data ll * mS ar ^. hldden from vlcw in accor " 

increasing the size of the selected item (so-called "zooming da ^ W * th the P^sent invention, 

in") by using a pointer of an input device such as a mouse, u p IG. 3 15 a *f * ° display of of 1 

determining whether it is the desired item, reducing the size bein S represented by the corresponding landmarks in accor- 

of the selected item (so-called "zooming out") if it is not 55 dance Wlth the P resent inventl0n i 

what the user intended, and repeating this operation from the FIG. 4 is a screen display of one landmark being dis- 

beginning with other items. It is apparent that the described P* a y ed with its corresponding data items according to one 

selection procedure is inconvenient and time-consuming. aspect of the present invention; 

Another solution to the above viewing problem may FIG. 5 is a screen display of a menu of functions asso- 

include a concept of a so-called graphical universe. Namely, 60 ciated witt > lh e corresponding landmark according to another 

the graphical universe may include a virtually unbounded as P cct of lhc present invention; 

space in which the data items are located, while the screen FIG. 6 is a display screen of the "relative positioning" 

display provides a viewing window into the universe (that is, feature according to yet another aspect of the present inven- 

displays a portion of the universe). By panning or scrolling lion; and 

in horizontal or vertical directions using the input device, the 65 FIG. 7 is a functional diagram of the operation of a 

user may view the entire universe and keep adding new data microprocessor for effecting the above and additional 

items without reducing their size. aspects of the present invention. 
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In all Figures, like reference numerals represent the same lines that give the universe structure and pattern are referred 

or identical components of the present invention. to by the user when navigating its space, while the land- 
marks allow the user to easily recognize data items stored at 

DETAILED DESCRIPTION OF THE a particular portion of the universe. This is similar to 

PREFERRED EMBODIMENTS s people's natural inclination to use landmarks in the real 

The present invention will now be explained in detail with world to identify or memorize things, or to find their way 

reference to the accompanying drawings. around. 

FIG. 1 shows a screen display 100 of a computer system Another analogy with the present inventive aspect may be 

controlled by a microprocessor 10 having an input device a desk where a person at the desk prioritizes the items by 

(not shown), such as a mouse, lightpen or keyboard for 10 placing one group of items on a right side, another groups of 

manipulating data items on the screen display 100 of a items in the middle of the desk, and a third groups of items 

monitor, etc. of the computer system. As further illustrated on a left side of the desk. Similarly, the viewing area as 

in FIG. 1, a plurality of data items are representatively shown in FIG. 3 provides a personal user space, allowing 

displayed on the display screen 100. The data items are one to prioritize and easily recognize where various groups 

arranged into three groups according to preselected user 15 of data items are displayed (stored) in the universe, 

criteria. As previously slated, in accordance with one aspect of the 

For example, the user decides to scan (digitize) photo- present invention, the landmarks may have different shapes, 

graphs in a family album and to enter the images of the sizes, colors, etc. to provide easy-to-remember identification 

photographs into the computer system. Obviously, one of the of data items represented by a respective landmark, 

advantages of the images stored in the computer system is In accordance with another aspect, the user may decide 

the user's ability to sort the images in a particular, pre- not to hide data items associated with the corresponding 

selected order and to quickly access these images. Thus, the landmark, as shown in FIG. 4. That is, by selecting another 

user arranges the images of the family album photographs menu item ("Landmark with Data Items" for example), the 

displayed on the screen display 100 into three groups, for user may view the landmark 114 with its associated data 

example: a first group 102 may contain digitized photo- items (images of photographs taken on the 6-month world 

graphs from the wedding (that is, wedding pictures); a cruise). This option may be useful in selecting only those 

second group 104 may include baby pictures; and a third data items which are currently of interest, without cluttering 

group 106 may be pictures from the 6-month cruise around up the viewing space with other data items associated with 

the world. 3Q the corresponding landmarks. 

After separating the images into the three groups, the user In accordance with yet another aspect of the present 

activates a menu, for example, on the screen display 100, as invention, each landmark may have a plurality of functions 

shown in FIG. 2. That is, let it be assumed that the user associated with it. Namely, when the user zooms in or clicks 

manipulates the input device (not shown) so that a menu on the landmark, a menu of functions 116 appears in 

"zooms out" (appears) on the screen display. 100 as shown 35 correspondence with that landmark, as illustratively shown 

in FIG. 2. As an example, the user manipulation may include in FIG. 5. Each menu item represents a particular function 

placing a cursor on a box 108 (FIG. 1) and activating performed on the data items and/or the landmark itself, such 

(clicking) a particular button on the mouse, etc. It is as "Display", "Sort", "Search", "Animation", "Clock", 

understood, of course, that other ways of activating and/or "Beacon", "Sound". By choosing the menu item "Sort" from 

placing a menu on the display screen 100 are possible, as 4Q the menu of functions 116, the images are sorted on the 

known to those skilled in the art of Graphical User Inter- screen display, as specified by the user, for example. Further, 

faces. a particular image may be searched for by using the 

One of the items in the menu is a "landmark" feature. By "Search" menu item, or animation/sound may be 

selecting and activating this feature and then pointing a reproduced, if available, according to another menu item, 

cursor at the group 102, the user can hide this group (the 45 The "Beacon" menu item may, for example, provide a 

wedding images) and replace it with a graphical object (a blinking landmark to give even further importance to that 

so-called landmark 110) for representing the wedding particular group of data items, if desired, 

images. As shown in FIG. 2, grid lines (that is, horizontal It will be appreciated that certain menu items in the menu 

and vertical lines) appear on the screen display in response of functions 116 may have additional sub -menu items, 

to the user activation of the "landmark" menu item, at the 50 so-called drop-down lists, which are displayed when that 

intersection of which the landmark 110 is positioned. menu item is selected by the user. For example, the "Sort" 

The landmark 110 has a shape which uniquely identifies menu item may offer the drop -down list of various options 

the group 102. That is, the user may be given a choice of available to the user for sorting the images (by date when the 

selecting a graphical object from a sub-menu or palette, for picture was taken, by date when entered into the computer 

example, which may appear on the screen display 100 in 55 system, etc.). 

response to the "landmark" menu item selection; or the user In accordance with still another aspect of the present 

may even create its own graphical symbol for identifying the invention, all landmarks in the graphical universe may be 

group of data items. In addition to shape, such display displayed on the screen display 100 by using a "relative 

attributes as color and size of the landmarks may be freely positioning" feature. As stated above, the concept of the 

selected to associate the group of data items with the 60 graphical universe includes a virtually unbounded space in 

corresponding landmark. which data items (represented by landmarks according to the 

FIG. 3 shows the screen display 100 with all three groups present invention) are located. The screen display 100 

102, 104, 106 being replaced with (and represented by) provides a window into the universe (that is, a view of a 

landmarks 110, 112, 114, respectively. As is apparent from portion of the universe). By panning or scrolling in the 

the figure, the landmarks 110, 112, 114 "personalize" the 65 horizontal and/or vertical direction using the grid lines as the 

user space in the graphical universe. Namely, the screen navigation tool, the user can determine where in the universe 

display 100 takes on the appearance of a street map: the grid the landmarks (with its corresponding data items) are 
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located with respect to other landmarks (and data items). 
Further, if the user desires to obtain the view of the entire 
universe, the "Relative positioning" menu item may be 
activated. 

This feature of the present invention (that is, the relative 5 
positioning) places all landmarks on the screen display 100, 
while maintaining the relative position of each landmark 
with respect to other landmarks as shown in FIG. 6. In 
particular, as the "Relative Positioning" feature is activated 
(that is, this feature can be turned on and off whereby the 10 
view is switched between the true positioning and relative 
positioning), the position of each landmark in the graphical 
universe is adjusted in such a way as to bring the landmarks 
into the viewing portion (that is, the screen display 100) 
while maintaining their relative positions with respect to 15 
each other. As a result, a complete "picture" of the land- 
marks may be obtained and their positions in the graphical 
universe. It is noted that as the "Relative Positioning" 
feature is activated, the space is reduced while the prede- 
termined size of each landmark remains constant. In 20 
addition, the grid lines may merge with each other during the 
relative positioning. 

The general idea of persistence is that certain objects tend 
to remain visible and constant in size when zooming out 
while other objects around them tend to become smaller 25 
and/or disappear. 

In the representative zooming space, there are at least 
three types of objects: data objects, landmarks, and grid 
lines. These objects function slightly differently when the 3Q 
space is being zoomed. Data objects function the same as 
one would normally expect: that is, as the data objects are 
zoomed out, they appear to become smaller and smaller until 
they eventually disappear. 

In contrast to this, landmarks and grid lines are said to be 35 
persistent. Landmarks have a minimum size, and once they 
reach that minimum size, the landmarks stay at that size 
even as the data objects around them continue to become 
smaller. When one landmark comes into contact with 
another, the two will "collapse" into one with the oldest 40 
landmark remaining. Grid lines are also persistent. They 
appear as a single line and do not change in width when 
zooming in or out. As one grid line comes into contact with 
another parallel grid line, the two grid lines "collapse" into 
one and stay that way as long as the user is zooming out. 45 

Thus, as data objects quickly decrease in size and/or 
disappear, landmarks and grid lines appear to remain per- 
sistent in size. As the user continues to zoom out, the 
landmarks and grid lines move closer to each other, "col- 
lapsing" on each other until eventually only a single land- 50 
mark and one vertical and horizontal grid line are left on the 
screen. As the user zooms back in, he or she will see their 
space unfold with the single grid line separating and becom- 
ing two grid lines, then three, etc. The same will happen for 
landmarks until all grid lines and landmarks return to their 55 
separate and true positions. 

FIG. 7 is a functional diagram of the operation of the 
microprocessor 10 to effect the aspects of the present inven- 
tion. After the step 700 in which the operation is initiated, 
two modes are encountered. In step 702, the "browse" mode 60 
(being a default mode) is executed where several operations 
may be carried out depending on the options selected by the 
user. Namely, in step 704, if the user zooms in on the 
landmark, the "zoom" feature, as carried out by the micro- 
processor 10, increases the size of the data items associated 65 
with the corresponding landmark 102, 104 or 106 on the 
screen display 100. The "Hyperlink" operation in step 706 



684 

6 

moves the view so that the indicated landmark appears in the 
center of the screen display 100 for focusing on that 
landmark, if desired. In step 708, the microprocessor 10 is 
operative to change the view of the graphical universe in the 
X-Y direction (that is, to perform a so-called "panning" 
operation); while the "Relative Positioning" in step 710 
allows the user to view all of the landmarks in the universe, 
where the microprocessor 10 is operative to reposition the 
landmarks in such a way as to display them on the screen 
display 100, as explained above. 

If the "Edit" mode in step 712 is selected, several 
operations, in addition to those in the "Browse" mode 
become available to the user. In particular, if it is desired to 
move the landmarks and/or grid lines, the "move" procedure 
is carried out in step 714; in addition, the landmarks and/or 
data items may be added to the screen display 100 (step 
716), deleted from the screen display 100 (step 718), or 
changed (step 720) in response to the user input. Further, in 
step 722, the "Palette" feature may be used to select the 
shape, color, etc. (that is, display attributes) of the existing 
or newly created landmarks. 

FIGS. 1-6 show the screen display 100 under the control 
of the microprocessor 10. It will be appreciated that any 
other programmable controller (processor) may be pro- 
grammed to effect the operations of the present invention as 
described above with reference to those figures and in 
accordance with the functional diagram of FIG. 7. 

Having described specific preferred embodiments of the 
invention with reference to the accompanying drawings, it is 
to be understood that the invention is not limited to those 
precise embodiments, and that various changes and modi- 
fications may be effected therein by one skilled in the art 
without departing from the scope or the spirit of the inven- 
tion as defined in the appended claims. 

What is claimed is: 

1. A computer system for controlling a screen display of 
a plurality of data items, comprising: 

a screen for displaying said screen display; and 
a controllable processor programmed to arrange said 
plurality of data items into a number of groups on said 
screen display, to generate a graphical object and to 
assign the generated graphical object to one of said 
groups for representing respective data items associ- 
ated with said one group, said controllable processor 
being further programmed to generate two non-parallel 
lines corresponding to said graphical object which is 
positioned at an intersection of said two lines providing 
directional orientation when said graphical object is 
displaced on said screen display, said two non-parallel 
lines moving with said associated graphical object upon 
movement of said graphical object; 
wherein said screen display is selectively displayable in at 
least two modes, a first display mode allowing said 
controllable processor to scroll said graphical object off 
said screen display such that additional graphical 
objects can be added and fit on said screen display 
without a reduction in size of said graphical object and 
said additional graphical objects, whereby a graphical 
universe exceeding said screen display is created, and 
a second display mode allowing said controllable pro- 
cessor to display all of said graphical universe on said 
screen display at one time in such a way that a relative 
positioning of said each graphical object in said graphi- 
cal universe is maintained on said screen display. 

2. The computer system according to claim 1, wherein 
said controllable processor is programmed to generate said 
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graphical object in such a way that display attributes of the 
generated graphical object differ from said display attributes 
of another graphical object displayed on said screen display. 

3. The computer system according to claim 2, wherein 
said display attributes include at least one of the following: 5 
shape, color, size, animation and function. 

4. The computer system according to claim 1, wherein 
said controllable processor is programmed to display said 
graphical object with the data items in said associated group. 

5. The computer system according to claim 1, wherein 10 
said controllable processor is programmed to generate on 
said screen display a menu of functions associated with said 
graphical object, said menu of functions containing multiple 
menu items for selectively performing multiple operations 
on said graphical object or the data items in said group 15 
associated with said graphical object. 

6. The computer system according to claim 1, wherein 
said controllable processor is programmed to selectively 
switch between said relative positioning and a true position- 
ing representing actual positioning of said graphical object 20 
in said graphical universe. 

7. A method for controlling a screen display of a plurality 
of data items, comprising the steps of: 

arranging said plurality of data items into a number of 

groups on said screen display; 25 
generating a graphical object; 

assigning the generated graphical object to one of said 
groups for representing respective data items associ- 
ated with said one group; 3Q 

generating two non-parallel lines corresponding to said 
graphical object which is positioned at an intersection 
of said two lines providing directional orientation when 



8 

said graphical object is displaced on said screen 
display, said two non-parallel lines moving with said 
associated graphical object upon movement of said 
graphical object; 

scrolling said graphical object off said screen display such 
that additional graphical objects can be added and fit on 
said screen display without a reduction in size of said 
graphical object and said additional graphical objects, 
whereby a graphical universe exceeding said screen 
display is created; and 

displaying all of said graphical universe on said screen 
display at one time in such a way that a relative position 
of said each graphical object in said graphical universe 
is maintained on said screen display. 

8. The method according to claim 7, wherein display 
attributes of the generated graphical object differ from said 
display attributes of another graphical object displayed on 
said screen display. 

9. The method according to claim 8, wherein said display 
attributes include at least one of the following: shape, color, 
size, function and animation. 

10. The method according to claim 7, wherein said 
graphical object is displayed with the data items in said 
associated group. 

11. The method according to claim 7, further comprising 
generating on said screen display a menu of functions 
associated with said graphical object, said menu of functions 
containing multiple menu items for selectively performing 
multiple operations on said graphical object or the data items 
in said group associated with said graphical object. 

* + + + * 
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